Note on nonequilibrium stationary states and entropy 
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In transformations between nonequilibrium stationary states, entropy might be a not well defined 
concept. It might be analogous to the "heat content" in transformations in equilibrium which is not 
well defined either, if they are not isochoric (i.e. do involve mechanical work). Hence we conjecture 
that un a nonequilbrium stationary state the entropy is just a quantity that can be transferred or 
created, like heat in equilibrium, but has no physical meaning as "entropy content" as a property 
of the system. 
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I. Thermostats and chaotic hypothesis. 

In studying equilibrium and nonequilibrium thermo- 
dynamics the notion of thermostat plays an important 
role: it is usually defined phenomenologically 1 as a sys- 
tem capable only of exchanging heat without changing 
its temperature or performing work (hence it is ideally 
an infinite system). 

In a statistical mechanical approach to a theory of the 
nonequilibrium stationary states of a system which is 
subject to external non conservative forces, which (there- 
fore) perform work, thermostats must then be present 
to avoid that the work performed by the external forces 
causes an increase of the energy beyond bounds. In sta- 
tistical approaches the thermostats must be defined as 
mechanical forces: the routes that one can follow are 

(i) Introduce stochastic forces acting on the system (usu- 
ally on the boundary) 

(ii) Assume that the system interacts via conservative 
forces with infinite systems ("thermostats") which are 
initially in equilibrium and which one would like to show 
that by interacting with the system the thermostats will 
undergo only changes localized in the vicinity of the con- 
tact surfaces 

(iii) Assume that the interaction with the "outside world" 
is modeled by an effective force on the system which bal- 
ances the work of the external forces working on the sys- 
tem (c/. Eq. below) thus allowing the system to reach 
stationarity. 

The third possibility has recently emerged as a very 
convenient way of studying the problem, since it at least 
avoids the virtually untractable theory of the behavior 
of systems in contact with infinite reservoirs. However 
it is often regarded as "unphysical" because it "amounts 
to modifying the system's equations of motion" . But 
the equations of motion are modified also if one uses 
the option (i), while the option (ii) is interesting but 
not really suitable for investigations which, at least until 
now, mostly rely on numerical experiments. Furthermore 
theoretically the only "infinite thermostats" which have 
been considered are infinite systems of free particles in- 
teracting only with the particles of the system and not 
directly with each other, a rather restricted case. 



Here we shall model thermostats by mechanical forces 
acting on the system, however we do not want to make 
very specific choices of the forces and the thermostats 
since we are interested only in general properties which 
would be shared by "any" (reasonable) choices of the 
forces and thermostat models. We think that the me- 
chanical models of thermostats fall into "equivalence 
classes" , just as one thinks that phenomenological ther- 
mostats do. Therefore we consider mechanical systems 
which, in spite of being acted upon by nonconservative 
forces, are kept in a nonequilibrium stationary state with 
the help of other mechanical ( "thermostatic" ) forces and 
study which relations, if any, can be established about 
transitions between stationary stated. We restrict our- 
selves here to transformations between stationary states 
which are " quasi static" transformations through inter- 
mediate stationary states. This means that on the time 
scale of the observations the control parameters {e.g. vol- 
ume, strength of the external forces etc.) of the station- 
ary states are kept fixed long enough so that the system 
can at any time can be considered to be in a stationary 
state. This is a generalization of reversible transitions in 
equilibrium. 

We consider only systems consisting of many particles 
and we do not consider systems that are modeled by con- 
tinua. Continua could be considered but one first must 
understand the thermodynamics of simple systems^. The 
particle motions occurring in a simple system are as- 
sumed to be chaotic: the Chaotic Hypothesis^, essentially 
states that an isolated system of particles has a chaotic 
evolution on microscopic time scales (see below). 

A simple system will be described by a differential 
equation in its phase space: we write it as x — Xe(x) 
where x = (q,q) £ R 6N = £1 {phase space), ./V=number 
of particles, m= mass of the particles, with 



mq = f{q) + E ■ g{q) - § E {q, q) = X E {x) 



(1) 



where f{q) describes the internal (conservative) forces 
{e.g. hard cores), E_ ■ g{q) represents the "active exter- 
nal forces" (nonconservative for the reasons mentioned 
at the beginning) acting on the system: for definiteness 
we suppose that they are locally conservative (like an 
electromotive force) but not globally, and d_ E is the force 



2 



law which models the action exerted by the thermostat 
on the system to keep it from indefinitely acquiring en- 
ergy: this is why we shall call it a mechanical thermostat. 
Linearity of the dependence on the "fields" E is only for 
convenience: we are not assuming them to be small (the 
theory of linear nonequilibrium is amply discussed in the 
literature^). More generally the external forces could be 
velocity dependent and even time dependent (periodi- 
cally) but we restrict ourselves to positional forces only 
for simplicity. 

Models of thermostats in the above sense can be very 
different even for the same macroscopic system; for in- 
stance (a list far from exhaustive) 

(1) assuming the system to have hard cores (e.g. a 
granular material of the type considered in&) one can 
consider inelastic collisions, e.g. suppose that the head- 
on component of the energy is decreased by a scale fac- 
tor rj < 1 upon each collision or, alternatively, the total 
energy of the two colliding particles is rescaled after a 
collision and assigned a value 2|fceT (this is essentially 
"Drude's conduction model") 7 , or 

(2) assuming that there is a background friction $j — 
—vqi, v > 0, for all components of xj or 

(3) assuming minimum effort to keep, say, the total 
kinetic energy or the total energy constant, ("Gaussian 
thermostat"—). 

Remark: the restriction that the external forces (E_ ■ 
g(qj) be positional is a strong restriction as it does 
not allow velocity dependent forces or several different 
thermostats as needed in any heat conduction problem 
where the nonequilibrium stationary state is achieved by 
putting the system in contact with two reservoirs with- 
out any external forces acting. However, such cases could 
also be considered^, but we do not treat them here since 
we want to restrict ourselves to the simplest case. 

We shall assume about the system which we consider 
the 

Chaotic Hypothesis^: The system evolution is supposed 
to be as chaotic as possible, i.e. to be hyperbolic (one also 
says, technically, that the system is "an Anosov system"). 

which will be a key assumption in our analysis. 

II. SRB statistics and nonequilibrium ensembles 

Any initial state x, randomly chosen in phase space 
with a probability distribution which has a density in 
phase space (i.e. such that the probability of a phase 
point q, q to be in dqdq has the form p(q, q)dqdq for some 
probability density p(q, q) > in phase space), will admit 
a statistics (under the above chaotic assumption): i.e. for 
all (smooth) observables F 

km 1 f F(S t x)dt = [ Mdy)F(y) (2) 



where /is is a stationary probability distribution on 
phase space, called the SRB distribution or also SRB 
statistic&m^H. This is a (nontrivial) consequence of 
the above chaotic hypothesis. 

Definition: A system in a microscopic state x, which 
has SRB statistics he, is said to be in the stationary state 
fiE- The collection of all stationary states of a system 
that are constructed by varying the parameters (typically 
the volume V of the container, the number of particles 
N, the external forces E, etc) will be called a "nonequi- 
librium Ensemble". 

The Ensemble (with capital E) is therefore a collection 
of probability distributions which we distinguish from 
what, following Gibbs, has become established terminol- 
ogy where ensemble indicates a single element of the col- 
lection, with fixed control parameters: what is usually 
called simply the "microcanonical ensemble with param- 
eters U, V" is here just a single element of the collection 
(i.e. the Ensemble) of microcanonical probability distri- 
butions. 

The notion of Ensemble in nonequilibrium is wider 
than in equilibrium since it depends also on the equa- 
tions of motion, because of the presence there of the ther- 
mostats. However, one expects that, as happens in equi- 
librium statistical mechanics, there should be "equivalent 
Ensembles" corresponding to classes of different possible 
models for thermostats acting on a system&il. 

Equilibrium is a special case of a nonequilibrium sta- 
tionary state: in such case E_ = and d_ E — and 
the chaotic hypothesis implies the validity of the ergodic 
hypothesis 11 ; the Ensemble (or collection) of SRB distri- 
butions each of which can be parameterized by the total 
energy U and volume V coincides with the corresponding 
collection of microcanonical ensembles^ 1 . Furthermore, 
in general, the chaotic hypothesis implies that observ- 
ables that are represented by smooth functions on phase 
space have finite time correlations which converge expo- 
nentially fast to their stationary state averages (i.e. SRB 
averages). 

We now want to consider which relations can be es- 
tablished in general between the properties of stationary 
states that can be transformed into one another by chang- 
ing reversibly the external parameters, just as is done on 
equilibrium states. 

In fact, if we limit ourselves to equilibrium states first 
then it is well known since Boltzmann (in his papers in 
the period 1866-1884, seei^) that if a transformation gen- 
erates an energy variation dll and a volume variation dV 
when the pressure (defined as a time average of a function 
defined on phase space, see for instance^) is p and the 
average kinetic energy is |AfcsT then, see™ appendices 
Al.l and A9.3, 

dU+ T PdV = exact differential (3) 
while dU + pdV is not exact, except in the isochoric case 
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(i.e. when dV — 0) and it is called the heat transferred 
from the heat reservoirs to the system. It makes no sense 
to talk of heat content contained in the systemM, unless 
one limits oneself to isochoric transformations: there is 
no heat content of a system because one cannot distin- 
guish between the heat and the mechanical work contents 
unless one allows only isochoric transformations in which 
the system performs no work (and in that case it is just 
another name for the internal energy). 

Defining the entropy content of a system as an integral 
S of the exact differential (dll + pdV)/T, an immediate 
question is whether one can extend the notion of entropy 
content to non equilibrium states. 

III. Entropy production rate and temperature. 

The proposal that emerges from various theoreti- 
cal considerations and a number of numerical expe- 
riments2*iiiiSii& ; is to define, if ks is Boltzmann's con- 
stant, 

Definition: The entropy production rate in a stationary 
state he_ is Ubo~+ with (cf. Eq.^)): 

Jn 

where a(x) = — divergence of X ,,■ (x) (i.e. cr(x) is the 
phase space contraction rate) and [j,e is the SRB statis- 
tics. 

This definition elicits a few comments: 

(a) There is no generally accepted definition of entropy 
in nonequilibrium stationary states. 

(b) In several thermostat models considered in the lit- 
erature the average divergence <r+ of the equations of 
motion is essentially related to W, the average work 
per unit time done by the thermostatting forces, i.e. 
to the time average W of q ■ fl(q,q), which in station- 
ary states equals the average work done by the external 
forces. For instance if $(q, q) is proportional to q, i.e. 
$(q, q) = a(q, q) q for some function a, then W = (aq 2 ) 
while" o _|_ = Jo-j= 3N(a) + {(d q a)q): hence W ~ (a)2K 
and (T+ ~ 3N(a) so that in such cases W and tr+ are 
related by <r + = 2 k/3n • Since the work done by the 
thermostatting forces is naturally interpreted as the heat 
that the system cedes to the thermostat we see that in 
the cases considered (i.e. $(q,q) — a(q,q)q) the quan- 
tity (T+ has the meaning of the entropy increase of the 
thermostat. 

(c) An important general theorem^, guarantees that 
cr_|_ > 0, and <7_|_ = corresponds to the case in which the 
SRB distribution \ie_ admits a density on phase space, 
a case that one naturally identifies with an equilibrium 
state and which essentially happens only if E = 0. 

Certainly the above three properties are, at best, only 
an indication that the phase space contraction can be in- 



terpreted as the entropy increase of the thermostats (in 
the classical sense of the word and due to the heat gener- 
ated by the system) . If we used phenomenological ther- 
mostats they would be systems in thermal equilibrium 
and at a fixed temperature so that the heat absorbed per 
unit time would generate an entropy increase of the ther- 
mostats which is well defined. Here one has to bear in 
mind that the the notion of heat absorbed by a mechani- 
cal thermostat as well as the notion of its temperature are 
new concepts. We use the arbitrariness offered us by the 
lack of a generally accepted definition of these concepts 
to conjecture the above definition of the entropy produc- 
tion rate on the basis of the general result in (c) which 
guarantees the positivity that is desired for compatibility 
with classical thermodynamics. 

The notion of temperature of a thermostat is however 
still missing but the above definition leads to a definition 
of an effective temperature of the thermostatting forces 
(we stress that there is no universally accepted defini- 
tion of temperature in systems out of equilibrium, even 
if stationarjiSiii). Here we propose 

Definition: the (effective) temperature T of the ther- 
mostats for a stationary nonequilibrium state is 



where W is the average work per unit time done on the 
system by the external forces, equal to the average work 
Q done on the thermostatting forces, and kga^ is the 
entropy production rate. 

The equality between W = (E ■ g(q) ■ q) and Q = 
($ • q) is due to the fact that the internal forces being 
conservative perform zero work in the average. 

Remark: the situations in which there is heat conduc- 
tion between different thermostats is not considered here: 
in such cases one has at least two thermostats acting on 
the system: i.e. the thermostatting force $ is then the 
sum of, for instance, forces $ = + $ 2 > which perform 
the work —Qi and —Q2, respectively, so that the diver- 
gence o~(x) is the sum of two quantities o~x(x) and 02 (a;). 
Therefore in such cases it will be natural to define the 
temperatures of the two thermostats as Tj = k ^ : we 
do not discuss the matter further since, from the outset, 
we are not considering situations in which the system is 
subject to several thermostatting forces. 

The above definition does not make sense as such in 
equilibrium because it becomes 0/0: however, one can 
imagine introducing a small forcing E_ and a correspond- 
ing thermostat. Then in the limit of vanishing forcing 
this yields a definition of T which by the "fluctuation 
dissipation theorem" can be checked to be the correct 
equilibrium temperaturaSiiSiiSiSi. 

Our definition of nonequilibrium temperature has al- 
ready been hinted at by F. Bonetto and N. Menon as well 
as used in the literatu re 6 ! 18 , in particular cases. 
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Adopting the above concepts leads naturally to giving 
up the possibility of defining the entropy content of a 
nonequilibrium stationary state because the system cre- 
ates entropy at a constant rate and if one would insist in 
defining the entropy content of a dissipating (i.e. with 
<t+ > 0) stationary state one would be compelled to as- 
sign to it a value — oo. Thus in our view of nonequilibrium 
stationary states the entropy ends up to be undefined and 
one can speak meaningfully only of "entropy production" 
or "entropy transfer": much as the "heat content" of a 
system is undefined in equilibrium, but production and 
transfer of heat are well defined. 

IV. Discussion. 

(1) Having defined the notion of entropy production 
rate one can define a "duality" between fluxes Jj and 
forces Ej using fcscr+ = fee / n(dx)a(x) as a "generating 
function" : 



Jj(M) = k B 



which, in the limit E = 0, leads to Onsager's reciprocity 
and to Green-Kubo's formulae for transpor1*i2i2£. 

(2) We have proposed a general definition of entropy 
production rate and of temperature for a class of sta- 
tionary states. But a new definition is really use- 
ful if it is associated with new results: we think that 
such new results may already be around and cluster 



around the fluctuation theorem, for which we refer to the 
literaturoVi 6 ! 21 ! 22 ! 23 ! 24 ! 25 . 



(3) The reason for our conjecture on the absence of an 
entropy content in nonequilibrium stationary states dif- 
fers from the absence of heat content in equilibrium. This 
because in equilibrium the heat content cannot be defined 
separately from the mechanical energy content^. How- 
ever in a nonequilibrium stationary state the impossibil- 
ity to define entropy content is due to the steady entropy 
production, which makes the entropy content — oo. In 
spite of that there is an analogy in that both quantities 
can be transferred or produced and they can even be de- 
fined if one limits oneself to consider a suitably restricted 
class of transformations (e.g. isochoric transformations 
between equilibrium states for what concerns heat or gen- 
eral transformations between equilibrium states for what 
concerns entropy). 
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